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ABSTRACT 

A new set of color selection criteria (VJL) analogous with the BzK method is designed to 
select both star-forming galaxies (SFGs) and passively evolving galaxies (PEGs) at 2.3 < z < 
3.5 by using rest-frame UV-optical (V-J vs. J-L) colors. The criteria are thoroughly tested with 
theoretical stellar population synthesis models and real galaxies with spectroscopic redshifts 
to evaluate their efficiency and contamination. We apply the well-tested VJL criteria to the 
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HSTAVFC3 Early Release Science field and study the physical properties of selected galaxies. 
The redshift distribution of selected SFGs peaks at z~2.7, slightly lower than that of Lyman 
break galaxies at z~3. Comparing the observed mid-infrared fluxes of selected galaxies with the 
prediction of pure stellar emission, we find that our VJL method is effective at selecting massive 
dusty SFGs that are missed by the Lyman break technique. About half of the star formation in 
massive (M star > 10 10 M Q ) galaxies at 2.3 < z < 3.5 is contributed by dusty (extinction E(B- 
V)>0.4) SFGs, which however, only account for ~20% of the number density of massive SFGs. 
We also use the mid-infrared fluxes to clean our PEG sample, and find that galaxy size can be 
used as a secondary criterion to effectively eliminate the contamination of dusty SFGs. The 
redshift distribution of the cleaned PEG sample peaks at z~2.5. We find six PEG candidates at 
z>3 and discuss possible methods to distinguish them from dusty contamination. We conclude 
that at least part of our candidates are real PEGs at z~3, implying that this type of galaxies 
began to form their stars at z>5. We measure the integrated stellar mass density (ISMD) of 
PEGs at z~2.5 and set constraints on it at z>3. We find that the ISMD grows by at least about 
factor of 10 in 1 Gyr at 3<z<5 and by another factor of 10 in next 3.5 Gyr (l<z< 3). 

Subject headings: Cosmology: observations — Galaxies: evolution — Galaxies: formation — 
Galaxies: fundamental parameters — Galaxies: general — Galaxies: high-redshift — Infrared: 
galaxies 



1. Introduction 



Understanding galaxy formation and evolution remains one of the most outstanding questions in as- 
tronomy. According to the standard paradigm, galaxies are initially formed in the center of small cold dark 
matter halos, gradually assembled with time through hierarchical processes, and event ually evolved into pop - 
ulations with various color, size, morphology, etc., as observed in our local universe (IWhite & Reeslll 978) 



However, the physics behind this scenario is still poorly understoo d. Theoretical models (e.g.. lBenson et al. 
20031 : iBower et al.ll2006l : ICroton et alJl200a : iDe Lucia et al.ll200a) require complex ingredients (e.g., using 
feedback to quench star formation in galaxies) in addition to simple gas fa lling and cooling to reproduce even 



basic observations of near by galaxies, such as lumino sity function (e.g. , Blanto n et al. 



2002 : lBlanton et al.ll20oi) and color bimodality (e.g jKauffmann et al.ll2003l : lBell et al 



2001; Norberg et al 



2004; Bl anton et al 



2005). Since these ingredients are predicted (or designed) to begin to work since the universe is young, it is 
essential to test them through observational studies on the physical properties of high-redshift galaxies. 

During the 13.7 billion years of cosmic time, the era of 1 < z < 4 is of particular interest, in 
terms of star formation, stellar mass content, and galaxy morphology. First, although the i ncrease of cos- 
mic star formation rate d ensity (SFRD) with redshift is well studied out to z ~ 1 (e.g., iHopkinsI 12004 : 
Hopkins & Beacoml 120060 . the ques tion of whethe r the SFRD has a broad peak during 2 < z < 4 is still 
far from being finall y solved (e.g., IHopkinsI 120041 : iHopkins & Beacoml 120061 : IPerez-Gonzalez et al] 12008: 
Chary & Popdl2010l) . Furthermore, if such a peak exists, what is the mechanism that turns off the bulk of 
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star formation in the universe? Second, being related to the evolution of the SFRD, the assembly history of 
massive (> 10 n M(p) galaxies is still in question. A large number of massive galaxi es is found at z~2 (e.g., 
Daddi et alJb o04bl: lFontana et al]bq04l:lGlazebrook et al Il2004l:lsaracco et alfcoosh. but only a few of them 
are found at z>3.5 fe basher et alJ [2005l: bunlop et aul2007l : iRodighiero et al]|2007l : Iwiklind et al]|2008l : 
Mancini et al.ll2009l) . This dearth of massive galaxies at high redshift raises the question of when and how 
these giants were largely assembled in the universe. Last but not the least, the morphology of galaxies also 
undergoes a transition at z~3. Altho ugh being studied in detail in the local universe and even traced back 
to z~1.5 (Ivan d en Ber gh et al l boOcL the Hubble sequence of galaxy morphology is not believed to be in 



place at z~3 (IGiavalisco et all 1 1996 : 



Conselice et al 



2004; R avindranath et all 12006) because a large frac- 



tion of galaxies in that epoch has irregular shapes (chain-like, clumpy, multiple cores, etc.). Therefore, the 
origin and emergence of the Hubble sequence remains an open question. To answer all the above questions 
requires observational studies on the physical properties (e.g., star formation rate [SFR], stellar mass, and 
morphology) of galaxies at z~3. 

High-redshift galaxies can be effectively selected from deep sky surveys through their broad-band col- 
ors. Star-forming galaxies (SFGs) at z~3 and above are prevalently selected with the dropout method by lo 



eating the position of the Ly man break from their rest-frame UV colors (e.g.. lGiavaliscoll2002l : ISteidel et al. 



2003 



Giavalisco et al.ll2004l) . This technique has been pro ved to be very s uccessful because galaxies se 



lected in this way, namely, Lyman break g alaxies (LBGs, see Giayaliscobood . for a review), are spectroscop- 
ically confirmed as SFGs at high redshift (ISteidel et al.lll996al Jbl 1 19991 . 120031) with little co ntamination. Re 



cently, this technique has been extended to select galaxies at 1.4<z<2.5 (BX/BM galaxies. lAdelberger et al. 



2004: ISteidel et alJl2004D . However, the Lyman break technique misses one interesting galaxy population, 
namely dusty SFGs. How much this population contributes to the cosmic SFRD and number density of 
galaxies at z~3 is still controversial. Studies using far-IR or sub-millimet er (sub-mm) em i ssion from cold 
dust s how that some dusty galaxi es, for example sub-mm galaxies (e.g., Blain et al. 2002 : Chapman et all 
20031 . boO-ilswinbank et alJboOflV have SFRs up to ~ lOOOM /yr. The high SFRs of dusty galaxies imply 
that the contribution of this population to the cosmic SFRD at z~3 may not be ignored. To avoid underesti- 
mating the SFRD due to the exclusion of this population, a new color selection method is required to select 
SFGs independent of dust reddening. 

Besides dusty SFGs, passively evolving galaxies (PEGs) at high redshift are also missed by the Lyman 
break technique. Although PEGs contribute little to the SFRD, they are directly related to the ceasing of 
star formation in galaxies and to the history of stellar mass assembly in the universe. To search for this 
population, several color selection criter ia have been proposed. Among them, the most commonly used two 
are the Extrem ely Red Objects (EROs: iThompson 



a prop 
et al.ll 



McCarthy 2004) and Distant Red Galaxies (DRGs; 



1999; Daddi et al 



Franx et al. 2003 



2000 



Roche et al. 



van Dokkum et al 



2003 



2002 



2004 



2003; 



2006; 



Papovich et al.ll2006l) . EROs are selected with very red optical to near-IR color, typically (R — K)y ega > 5, 
while DRGs have a red near-IR color with (J — K)v ega > 2.3. Both methods use the red color as an 
indicator of the large amount of old stars in galaxies. However, due to the strong degeneracy between age 
and dust reddening, the red color of a galaxy could be caused by either old stars or high dust extinctions. 
As a result, samples selected by both methods contain both massive PEGs and dusty SFGs with similar 
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f ractions, as sh owed by spectroscopic observations (ICimatti et al, 1 I2002L 120031: iForster Schreiber et alJl2004l : 
Yan et alj|2004r) . To exclude the contamination of SFGs, a more efficient way of selecting PEGs at z~3 is 
needed. 

A selection metho d that satisfies the above requirements already exists for galaxies at z~2, as proposed 
by Daddi et al.1 (I2004ah . This method uses the B-, z-, and K-band photometry to select both SFGs and PEGs 
at z~2. Samples selected through the BzK met hod are now widely used t o investigate several aspects of 
galaxie s at z^2, from phy sical properti es (e.g., 



2007bUal: Blan c et al 
function dGrazian et al 



2008), abundance (IKong et al 



Daddi et al 



20071) . to clustering dKong et all 2006; 



2006; 



2004a, 2005 



Lane et al 



2007 



Blanc et al. 



Redd v et al. 



Blanc et al 



2008). 



2005: lDaddietal. 
2008b -. stellar mass 



In this work, we try to design an analogous method that selects and classifies simultaneously both 
SFGs (with different dust extinctions) and PEGs at 2.3<z<3.5. For this purpose, we extend the successful 
BzK method from z~2 to z~3 by replacing the selection bands with the V-, J-, and IRAC 3.6/xm band 
(hereafter L-band), according to the relative shift of galaxy spectra between the two redshifts. Our selection 
method (hereafter VJL) uses the same rest-frame colors as the BzK method so that galaxies selected by both 
methods have same spectral types. However, due to the different depth and sensitivities of the bands used in 
each method, the VJL selected sample may have different incompleteness and contamination from the BzK 
selected sample. 

Nowadays, ph otometric redshift (photo-z) can be fa irly accurately measured with relative error of only 
a few percent (e.g. Jllbert et al.ll2009l ; iDahlen et al.ll2010f) and is hence widely used to select galaxies within 
a certain redshift range. However, the bias of photo-z selection is not explicit. It is common to character- 
ize photo-z errors with a redshift probability distribution function (PDF). The accuracy of the distribution 
function strongly depends on the assumed mix of galaxy templates in the spectral energy distribution (SED) 
library. Unfortunately, our knowledge on the true SED types is limited and the commonly used SED li- 
braries are often not good representatives of real galaxies. Let alone the mystery of dust extinction curve, 
initial mass function (IMF), metallicity of high-z galaxies, one major uncertainty of fitting high-z galaxies 
is the unknown star formation history (SFH). The commonly used exponentially declined SFH (r-model) 
may be a suitable approximation for low-z galaxies, but is not a realistic model for hi gh-z galaxies. Recen tly 
postulated hypotheses on SF H of high-z gala xies include exponentially increasing (|Maraston et al.ll2010i ) or 
roughly linearly increasing (ILee et al.1 12010) SFH. Using an unrealistic SFH would eventually result in a 
mis-interpretation of the bias of photo-z selection. 

On the other side, the bias of color selection can be fairly explicitly determined. One easy way to 
do so is applying the color criterion to simulated galaxies that have a certain range of redshift, SFHs and 
extinctions and calculating the success and failure rate of the selection. Thus, one can robustly measure 
the expected redshift distribution as well as the incompleteness of the selection as a function of several 
variables, such as magnitude, size, and color of galaxies. Moreover, color selection is easier to reproduce. 
Unlike photo-z selections, results of which may vary from people to people, depending on the used SED- 
fitting codes or SED libraries, color selection results are robust and make the comparison of different works 
easy for the whole community. The success of color selection method has been proved by the prevalence of 
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Lyman break technique (see the review of lGiavaliscol l2002 ) . 



In this paper, we apply our VJL selection method to the HST/WFC3 Early Release Science (ERS, 



Windhorst et al. 



2011 ) observat ions in the south field of the Great Observatories Origins Deep Survey 



(GOODS. iGiavalisco et al.ll2004) South field (GOODS-S). Serving as an ideal test field of our selection 
method, ERS brings three advantages for us to calibrate and optimize our method. First, its deep (~27 
AB mag) J-band allows us to select galaxies that are faint in their rest-frame optical bands. These galaxies 
could be dusty SFGs and the ability to detect and correctly classify them is a key of our method. Second, 
embedded within GOODS South field, ERS is augmented by several existing data sets, from X-ray, optical, 
to mid-infrared band and sub-mm band. The multi-wavelength data enable us to accurately understand the 
nature of our selected galaxies. Third, ERS has similar depth on J- and H-bands as the upcoming CANDELS 
observation (|Grogin et al.ll201ll : iKoekemoer et al.ll201lh so that our method calibrated in ERS can be easily 
adapted to apply to CANDELS data. 

Throughout the paper, we adopt a flat ACDM cosmology with Q, m = 0.3, Q,\ = 0.7 and use the 
Hubb le constant in terms of h = Hq /100km s^ 1 Mpc -1 = 0.70. All magnitudes in the paper are in AB 
scale ( Okelll974 ) unless otherwise noted. 



2. The Data 



2.1. Images 



The ERS observation ([Windhorst et al.ll201 lb covers 40-50 arcmin 2 of the GOODS South field in 10 
bands. The data used in this work are its near-IR observations, i.e., F098M (Ys), F125W (J), and F160W 
(H) images. The 50% completeness limit for 5-er detections for typical compact objects (circular aperture 
with radius of 0.4" ) is 27.2, 27.55, and 27.25 for Ys, J, and H. We re-processed the images and drizzled 
them to a 0.06" per pixel scale and registered to the GOODS WCS. 

The GOODS south field has been observed with various telescopes and instrument combinations, 
from X-ray to sub-mm and radio . Relevant to our analysis here are imagines of Very Lar ge Telescope 
(VLT) /VIMOS ultra-deep U -band konino et alJbood) . HST/ACS BViz (biavalisco et al.ll2004b . VLMSAAC 
JHKs jRetzlaff et allboiob . Spitzer/IRAC 3.6, 4.5, 5.7, 8.0 /*m (M. Dickinson et al. in preparation), and 
Spitzer/MIPS 24 fim. Table Q] summarizes the sensitivity (limiting magnitude of S/N=5 for a point source) 
and resolution, namely, the full width at half-maximum (FWHM) of point-spread function (PSF), of each 
band used in this study. 

In our work, we also try to select an LBG sample at z~3 through the U-band dropout technique as a 
reference sample to compare to our VJL sample. The VLT/VIMOS U-band used in GOODS-S is blueward 
to the traditional U-band and would bias selected galaxies toward higher redshift. The other U-band in 
GOODS-S, namely the CTIO U-band, is a traditional U-band, but the depth of its imaging is about 1.5 mag 
shallower than that of VIMOS U-band. In order to select a relatively complete U-band dropout sample at 
z~3, we turn to use the multi-wavelength catalog of the GOODS North field (GOODS-N), where the KPNO 
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U-band imaging satisfies the requirements of being both traditional U-band and deep to valid our z— 3 LBG 
selection. Besides having the KPNO U-band and HST/ACS and Spitzer IRAC observatio ns, GOODS -N 



also has the grou nd-based NIR images observed through CFHT WIRCAM J- and K-band (ILin et al.ll201 1 



Wang et al. We list their sensitivity and resolution, together with those of KPNO U-band, in Table Q] 



Table 1: Sensitivity and Resolution of GOODS Filters 



Filter 


Sensitivity 


Resolution 




(Limiting Magnitude of 


(FWHM of 




S/N=5 for Point Source) 


PSF) 


VIMOS U 


28.00 


0.8" 


CTIO U 


25.8 


~1.5" 


KPNOU 


27.1 


1.15" 


ACS F435W (B) 


28.7 


0.08" 


ACS F606W (V) 


28.8 


0.08" 


ACS F775W (i) 


28.3 


0.08" 


ACS F850LP (z) 


28.1 


0.09" 


WFC3/IR F098M (Ys) 


27.2 


0.12" 


WFC3/TR F125W (J) 


27.55 


0.13" 


WFC3/IR F160W (H) 


27.25 


0.15" 


ISAAC J 


25.0 


-0.5" 


ISAAC H 


24.5 


-0.5" 


ISAAC Ks 


24.4 


-0.5" 


CFHT/WIRCAM J 


24.6 


-0.8" 


CFHT/WIRCAM K 


24.2 


-0.8" 


IRAC 3.6 /im (chl or L) 


26.1 


1.7" 


IRAC 4.5 fim (ch2) 


25.5 


1.7" 


IRAC 5.8 fim (ch3) 


23.5 


1.7" 


IRAC 8.0 fim (ch4) 


23.4 


1.9" 


MIPS 24 fim 


20.4 


6" 



2.2. Catalogs 



To robustly measure the photometry of objects in all ab ove bands with mix ed resolutions, we use a 
software package with object template-fitting method (TFIT: lLaidler et al.1 120071) . For each object, TFIT 
uses the spatial position and morphology of the object in a high-resolution image to construct a template. 
This template is then fit to the images of the object in all other low-resolution bands. During the fitting, the 
fluxes of the object in low-resolution bands are left as free parameters. The best-fit fluxes are considered as 
the fluxes of the object in low-resolution bands. These procedures can be simultaneously done for several 
objects which are close enough to each other in the sky so that the deblending effect of these objects on 
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the flux measurement would be minimized. Experiments on both simulated and real images show that 
TFIT is able to me asure accurate isophotal photometry of objects to the limiting sensitivity of the image 



( Laidler et al.l l2007). 



Catalogs of different fields (ERS, GOODS-S and GOODS-N) are generated based on different detection 
bands. In the ERS catalog, we use WFC3/IR H-band as the detection band as well as TFIT high-resolution 
template. ACS BViz and WFC3 YJH isophotal photometry is measured in dual-image mode by SExtractor 
based on H-band detection. U-band, ISAAC Ks-band, and IRAC 4 channels' photometry is measured 
through TFIT. For both GOODS fields, the ACS z-band is chosen as the detection band. ACS isophotal 
photometry is measured in dual-mode by SExtractor, while other bands' photometry is measured by TFIT 
with z-band template (N. A. Grogin et al. in preparation). All SExtractor isophotal and ground-based TFIT 
(isophotal) fluxes are converted to total fluxes by multiplying an aperture correction factor, which is the ratio 
of SExtractor FLUX_AUTO and FLUXJSO of the detection band of each filed (H-band for ERS and z-band 
for both GOODS fields). 

In addition to the above bands, the GOODS fields are also observed by the Spitzer MIPS 24/mi channel. 
Fluxes of sources in MIPS images are measured by fitting PSF to prior positions of objects detected in the 
Spitzer IRAC 3.6fim image. During the fitting, the positions of MIPS sources are allowed to wander by less 
than 0.6" from the IRAC prior position. After the first pass of fitting and subtraction of fitted MIPS sources, 
a second pass of fitting is run for MIPS sources that do not have IRAC counterparts. Sources detected and 
fit in both passes are combined together into the fina l MIPS catalogs. Details about the catalog of 24/mi 



photometry can be referred from lMagnelli et all (|201lh . To combine the TFIT and MIPS catalogs, we match 
sources in the two catalogs with positions, allowing a maximum matching distance of 1 .0" . 



3. Color Selection Criteria 

In order to si multaneously select both SFGs and PEGs at z~3, we extend the BzK method at z~2 



(Dad di et al.ll2004ar) to z~3 by replacing the B-z and z-K colors in the BzK criteria with the V-J and J-L 
color, as the rest-frame wavelengths observed by the BzK bands for a galaxy at z~2 are redshifted to the 
observation windows of the VJL bands at z~3. Because ratios of central wavelengths of the VJL bands 
to the BzK bands are not a constant, we also adjust the coefficient in the original BzK criteria so that the 
dust reddening vector is parallel to our selection window, which would ideally make our selection criteria 
independent of dust reddening. We determine the intersection terms of each selection equation through the 
distributions of galaxies with different redshifts in the J-L versus V-J color diagram (the right panel of Fig. 
[[]). Since the slope of the star-forming VJL criterion (Eq. []} is fixed based on the dust reddening vector, we 
shift the criterion line (the diagonal line in Fig. [B to get the term (+0.2) in Eq. [Qthat optimally separates 
galaxies at 1.5<z<2.5 (blue squares in the right panel of Fig. [T]) from those at 2.5<z<3.5 (red stars in the 
same panel). For the intersection term (2.5) in Eq. [2 since we do not have passive galaxies at 2.5<z<3.5 
that have been spectroscopically observed in our sample to help calibrate the selection window, we choose 
to use this term to exclude low-redshift interlopes as much as possible and meanwhile to keep the single 
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Fig. 1. — Left: tracks of galaxy models placed at different redshifts in the (J-L) vs. (V-J) two-color diagram. 
Symbols in each track are for redshift z=2, 2.5, 3, 3.5 and 4. Blue tracks are models with a constant star 
formation (CSF) rate, age of 0.5 Gyr and various dust reddenings (solid with filled points: E(B-V)=0.0; 
dotted with squares: E(B-V)=0.3; dashed with triangles: E(B-V)=0.6). Red lines show the tracks of dust- 
free SSP models with ages of 0.5 (solid with filled points), 1 (do t ted wi th squares), and 2 Gyr (dashed with 
triangles). Black stars show the locus of stars of iLejeune et al.1 (|1997T) . Right: ERS galaxies with spec-z 
in the (J-L) vs. (V-J) two-color diagram. Galaxies at different redshift ranges are color coded as labels 
show. The two solid black lines in each panel show our designed selection windows (upper left for sVJL 
and upper right for pVJL). In each panel, overplotted small dots show all ERS galaxies with S/N>=5 in J- 
and L-bands. 
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stellar population (SSP) model of galaxies with age of 1 Gyr (the red dotted line with squares in the left 
panel of Fig. [T]at z=2.5 within the selection window. Thus, our VJL criteria are 



for selecting SFGs and 



J-L> 1.2 x (V- J) + 0.2 



J - L > 2.5 f\ J - L < 1.2 x (V - J) 



0.2 



(1) 



(2) 



for selecting PEGs, where f\ means the logical and. Our method, similar to the BzK method, uses the 
strength and slope of the Balmer break, which is between the J- and L-bands for galaxies around z~3, to 
select SFGs and distinguish them from PEGs. For simplicity, in this paper, we call galaxies selected or 
selection window defined by Equation[T]as sVJLs, while those by Equation|2]as pVJLs. 



An extension of the Bzk method to higher redshift has been already proposed by 



who suggested to use R-, J-, and L-band colors to select galaxies at z>2.5. iDaddi et al.l ((2004a) tested the va 



Dadd ietalJ (12004a), 



lidity of the selection criterion in their K20 sample. They ended up with few detections at z>2.5, as the K20 
sample does not cover the redshift range z>2.5. They also claimed that using GOODS ACS+lSAAC+Spitzer 
data set would be deep enough in all of the RJL bands to detect galaxies at z>2.5. The RJL method is quite 
similar to out VJL, however, we use all space-based bands in our selection to ensure a deep sensitivity. An- 
other color selection ai ming toward selecting galaxies at 1.5<z<3.5 by using rest-frame UV/optical colors 
has been proposed by ICameron et al.l (120111) . They use HST Y-H versus V-z colors to identify and charac- 
terize 1.5<z<3.5 galaxies in the HUDF and ERS field. While their criteria have the advantage of having 
similar resolutions in all bands that are used for selection, our criteria cover a much longer wavelength 
baseline. And our reddest band (the L-band), a close proxy of stellar mass in the interested redshift range, 
enables our selected to be easily compared with a stellar mass selected sample. 

We test the validity of our VJL selection criteria in two ways. First, we study the evolutionary track 
of stellar population synthesis models along redshift in the (J-L) versus (V-J) two-color diagram. Second, 
we study the distribution of real galaxies from the ERS field with spectroscopic redshift (spec-z) in the 
two-color diagram. 

The left panel of Figure [Qshows tracks of shifting galaxy models along redshift (from z=0 to z=7) in the 
(J-L) versus (V-J) two-color diagram. Symbols in each track stand for models at (starting from the lowest 
one) z=2, 2.5, 3, 3.5, and 4. Galaxy models are retriev ed from an updated version ( CB09) of the s tellar 
population synthesis library of bruzual & Chariot! (12001 .BC 03) with the Safp eter IMF (IS arpeterll 1955D and 
solar metallicity. The Calzetti law (ICalzetti et al.ll 19971 . 120001) and the recipe of lMadaul (119951) are applied to 
each model to account for the dust reddening and the opacity of intergalactic medium (IGM) in the universe. 
Our selection windows corresponding to Equation Q] (the upper left region) and |2] (the upper right region) 
are outlined by black lines. 

Blue tracks stand for models with a constant star formation (CSF) rate, age of 0.5 Gyr and various 
dust reddenings (solid: E(B-V)=0.0; dotted: E(B-V)=0.3; dashed: E(B-V)=0.6). These tracks show two 
facts: (1) all CSF models enter our sVJL selection window in the redshift range of 2.3 < z < 3.5 and (2) 
the reddening vector (the black arrow in the panel) is almost parallel to our sVJL selection window (the 
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diagonal black line). We also test our criteria with models with older ages (2 Gyr) as well as models with an 
exponentially declining SFH (r-model, where r, the characteristic time scale of star formation, is fixed to 
1.0 Gyr). Both types of models have similar tracks as that of the CSF model with t=0.5 Gyr. These results 
demonstrate that our sVJL criterion can select SFGs with various SFH, age, and SFR independent of dust 
reddening. 

However, the CSF model with E(B-V)=0.6 enters our pVJL selection window twice, at 1.5 < z < 2.5 
and z > 4.0. Models with different SFH but same age and dust reddening also enter the pVJL selection 
window at similar redshifts. The behavior of these models suggests that our pVJL galaxies may be contam- 
inated by highly obscured SFGs from both lower (z < 2.0) and higher (z > 4.0) redshift, regardless of their 
exact SFH. 

Red tracks show the evolutionary track of dust-free SSP models with ages of 0.5, 1, and 2 Gyr. All 
three SSP models enter our pVJL selecting window, but at different redshifts: ~3.5, ~3.0, and ~2.5 for 
models with age of 0.5 Gyr (blue), 1.0 Gyr (green), and 2.0 Gyr (red). Overall, our pVJL criteria are able to 
select PEGs around z=2.5 and above. 

The right panel of Figured] shows our second test, that is the position of galaxies with different spec-zs 
in the (J-L) versus (V-J) diagram. This test with real galaxies supplements the first one in two ways: (1) 
it helps in understanding the effect of photometry uncertainty and (2) it shows how our method works for 
galaxies with unknown and perhaps more complex SFH. Galaxies with spec-z in the ERS are divided into 
different redshift ranges and shown by colors and labels. 

In this panel, the edge of our sVJL selection window effectively separates galaxies at 2.3 < z < 3.5 
from others, satisfying our expectation. However, several galaxies with lower redshift and a few with higher 
ones also enter our sVJL window. We suspect that photometry uncertainty is the main reason that scatters 
them into our sVJL window, although we cannot rule out the effect of a complex SFH. Few galaxies with 
(J-L) color redder than 2.5 are found in our spec-z sample. The lack of red galaxies is caused by the fact that 
spectroscopic observations are biased against dusty SFGs and PEGs because of their faint and featureless 
rest-frame optical spectra. It is also possible that red galaxies are really rare in the high-z universe. We note 
that a few galaxies from lower redshift (z < 2.5) and higher redshift (z > 4.5) enter the pVJL selection 
window. The existence of these types of contamination is consistent with our above analysis with theoretical 
models (see the left panel). We will discuss how to eliminate contamination in both selection methods later. 



in 



Active gal a ctic n ucleus (AGN) sources could also contaminate our VJL selected sample. As shown 



Civano et all (|2011 ). about 30% of AGN at z>3 show a typical optical spectrum of an SFG, but have 
X-ray luminosity > W AA erg/s, a typical va lue of quasars . In o rder to evaluate their contamination, we 



study the redshift tracks of AGN templates of IPolletta et al.l (120071) in the (J-L) versus (V-J) plot. Templates 



of type 2 QSO (QS02), type 1 QSO with the lowest optical-to-IR ratio (BQSOl), and type 1 QSO with 
the highest optical-to-IR ratio (TQSOl) are all within our sVJL selection window at z=0. However, QS02 
leaves the window quickly before z=0.5, and BQSOl also leaves the window around z=l. Given the small 
cosmic volume that our surveys observe at z<l, we argue that these two types of AGN would not severely 
contaminate our sample. The only template that stays in our sVJL selection window up to z>3.5 is TQSOl. 
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We also examine the track of AGN + star-burst template of 119254 of Poll etta et all (120071) . The template 
enters our sVJL selection window at z>2 and evolves to redder (J-L) direction within the window as redshift 
increases. It suggests that our red (J-L>2.5) dusty SFG sample could be contaminated by Seyfert 2 galaxy. 
We will discuss the possible contamination in detail later in Sec. 14.41 We also note that no QSO template 
enters our pVJL selection window, which indicates that our selected PEG sample is in principle immune 
from AGN contamination. 

As a summary, using both theoretical models (CSF, r-model, and SSP) and spectroscopically observed 
galaxies, we show that our sVJL selection window (defined by Equation Q]) can select SFGs with various 
levels of SFR independent of dust reddening at 2.3 < z < 3.5. And our pVJL selection window (defined by 
Equation [2]) can select PEGs around z=2.5 and above, although such a selected sample may be contaminated 
by dusty SFGs at z < 2.0 and z > 4.0. Also, no template at z < 1.5 or galaxies with spec-z<1.5 enters 
either of our selection windows, suggesting that our criteria are effective at excluding low-redshift galaxies. 



4. Star-forming VJL Galaxies 

We apply our sVJL criterion, defined by Eq. [TJ to the multi-wavelength catalog of the ERS field, 
which is based on the WFC3 H-band detection, as discussed in ^2.21 to select SFGs at z~3. To ensure an 
accurate measure of galaxy colors, we require all selected galaxies to have S/N>10 in J- and L-bands. We 
also construct a samples with S/N>20 in the two bands. Comparison between the two samples would show 
us how photometric uncertainty affects our selection results. For V-band photometry, if S/N<1, we use 
the la photometric uncertainty as the upper limit of flux. The two samples contain 354 and 146 galaxies, 
respectively. 

We note that the BzK color criterion of Daddi et al. J2004ah was constructed to be applied to K-selected 



samples. Similarly, one would expect the VJL criterion to be applied to L-band limited samples. Without an 
L-band detection, thus with an upper limit (at best) on the J-L color, no VJL galaxy can be unambiguously 
selected. Moreover, using L-band also ensures the closest proxy for mass selection of the sample. In this 
paper, we choose to apply the sigal-to-noise ratio (S/N) cut on both bands instead of on only the L-band so 
that we could have accurate J-L color. This is not contradictory with selecting an L-band limited sample. 
Instead, it asks for more strict constraint on the J-L color to exclude interlopes. This is well fitting the 
purpose of this paper to demonstrate the validity of the selection criterion. We also acknowledge that the use 
of S/N cut on two bands would bring a more complicated selection effect on the completeness of sample, 
because now the completeness is not only dependent on the proxy of mass, but also on the color. However, 
we will argue later (in §4.51 and §5-3b that the induced selection effect would not significantly change the 
quantitative results of comparing our VJL samples with other samples. 
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Fig. 2. — Accuracy of our photo-z measurement. Top: the comparison of photo-z and spec-z. The solid line 
shows the one-to-one correspondence. Bottom: the relative error as a function of redshift. For clarity, the 
bottom panel zooms into the range of -0.2<dz<0.2. The solid curve shows the mean of the relative error, 
while two dashed curves cover the lcr confidence level. 
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4.1. Deriving Physical Properties of Galaxies 



We derive photo-zs and physical properties of selected galaxies by fitting their SEDs to stellar popu- 
lation synthesis models. Models used to measure photo-zs are extracted from the library of PEGASE 2.0 
(IFioc & Rocca-Volmerangelll997r) . Instead of using the redshift with the least x 2 > we integrate the proba- 
bility distribution function of redshift (zPDF) and derive the likelihood-weighted average redshift. When 
the zPDF has two or more peaks, we only integrate the main peak that has the largest power. The accu- 
racy of our photo-z measurement is shown in Figure 12 where we compare our photo-zs and spec-zs of 
galaxies that are spectroscopically observed in the ERS field. The top panel shows a very good agreement 
between photo-zs and spec-zs. The relative error (defined as (z p h ot — z spec )/ (1 + z spec )) has an almost zero 
mean (0.0005) and a very small deviation (0.037 after 3a clipping). And the fraction of outliers, defined 
as |Az|/(l + z) > 0.15, is about 3.4%. The bottom panel shows the mean and standard deviation (after 
3-sigma clipping) of relative errors in each redshift bin with a bin size 0.5. The means of the relative errors 
have no significant offset from zero at all redshift bins, especially for the range of 2 < z < 4, which is of the 
most interest in this study. The high accuracy of our photo-z measurement enables us to statistically study 
the physical properties of our selected galaxies without spectroscopic redshifts. 

The physical properties (stellar mass, specific star formation rate [SSFR], and dust reddening) of galax- 
ies are measu red through SED-fitting models retrieved from the library of CB09 with the Salpeter IMF 
(ISalpeterill955r) . The lower and upper cuts on mass in the IMF are O.1M and 100M Q , respectively. The 
models consist of grid points in a parameter space spanned by redshift, dust extinction E(B-V), SFH (char- 
acterized by r and age ), and metallicity. The ava ilable values of e ach parameter are shown in Table [2 We 
apply the Calzetti law ( Calzetti et al. 1997 . 2000 ) and the recipe of Madau ( 1995b to the models to account 
for dust extinction and the opacity of IGM in the universe. For each model, the fluxes in all bands are pre- 
computed and stored in a grid database. When fitting a galaxy, we scan the database and calculate x 2 values 
for models in all grid points over the whole parameter space. The \ 2 value is calculated as 



X 



obs,i 



(3) 



where F \, s ^, F mo d e i,i, and o~i are the observed flux, model flux, and observational uncertainty in the ith 
band, a is a normalization factor, which is equal to stellar mass if F mo d e i,i is normalized to 1M in our 
pre-computed database. The model with the least \ 2 is considered the best-fit model and its parameters are 
used as the measurements of the properties of the galaxy. During the SED-fitting, the redshift of a galaxy is 
fixed as its photo-z or its spec-z, if the latter is available. 

In addition to the SED fitting with bands from U-band all the way to IRAC 8.0 /xm, we also estimate 
the E(B-V)s and SFRs of sVJL galaxies by using the slopes and fluxes of their rest-frame UV continuum. 
Compared with SED-fitting, this method is less model- dependent and requires no prior information on the 
SFH of galaxies. In this method, we use the Calzetti law dCalzetti et all 1994 , 2000 ) to convert the rest-frame 
UV-slope of a galaxy into its dust reddening, a nd calculate the u nobscured SFR from its dust-corrected rest- 
frame UV continu um by using the formula i n Kennicutt ( 199 81). Since the SFH s of high-redshift SFGs are 
controversial (e.g.. iLee et al.ll2010l : iMaraston et alj|2010l : IPapovich et al.ll201 ll) . we prefer to use E(B-V)s 



- 14- 

and SFRs estimated from UV continuum for SVJLs. 

Table 2: Parameter Space Used for SED-Fitting 

Parameter Range 

Redshift 0.0 to 7.0 with a bin size of 0.01 

E(B-V)1 0.0 to 1.0, AE(B - V) = 0.05 

Metallicity 0.004, 0.02, 0.08 

Age (Gyr) (1, 2, 3, 5, 8) x 10~ 3 , 10" 2 , 10 -1 , 10°, 10 1 , up to 13 

r (Gyr) (1, 2, 3, 5, 8) x 10~ 3 , 10" 2 , 10 -1 , 10°, 10 1 , and oo 



4.2. Redshift Distribution 

The redshift distributions of our sVJL samples with S/N>10 and 20 are shown in Figure [3] Both 
distributions highly peak around z~2.7 and extend to z>3.5, demonstrating that, as we expected, our sVJL 
criterion is effective at selecting galaxies between 2.3 < z < 3.5. The S/N>10 sample has a secondary peak 
around z=1.8, which is implying that the main contamination of our sVJL selection is coming from galaxies 
at z~2. Fortunately, this secondary peak is largely diminished in the S/N>20 sample. The number ratio 
between galaxies at z~1.8 and at z~2.8 decreases from 0.27 in the S/N>10 sample to 0.17 in the S/N>20 
one. It suggests that the low-z contamination in our sVJL sample is induced by photometric uncertainty 
rather than the deficit of our method and hence can be removed by increasing the S/N cuts in J- and L-band. 
In later study, to balance the fraction of contamination and the number of statistics, we use the S/N>10 
sample as our fiducial sample. 



4.3. Comparison with LBGs 

Nowadays, high-redshift SFGs are commonly selected through the Lyman break technique. In order 
to avoid the contamination zone of elliptical galaxies, this technique compromises to only select galaxies 
with a bright and blue rest-frame UV continuum, namely SFGs with low or no dust extinction. Dusty SFGs, 
whose rest-frame UV color mimics that of elliptical galaxies, are missed by this technique. Because of 
this bias, the existence and contribution of dusty SFGs to the cosmic SFRD at z~3 has been the topic of 
considerable debate. To shed a light on the above question, we compare galaxies selected through our sVJL 
method, which is designed to select both low-dust and dusty SFGs, with LBGs at z~3. 

The U-band dropout method is used to select LBGs at z~3, because the Lyman break of an SFG is 
redshifted to between the U-band and the B-band. A sample of 1161 U-band dropouts is selected from 
GOODS North (878) and South (283) fields with the following criteria: 



U-B > 0.75 + 0.5 x (B- z), 
U-B > 0.9, 



(4) 
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Fig. 3. — Redshift distributions of star-forming VJL galaxies. Solid line stands for the sample with S/N>10 
in J- and L-bands, while filled gray histogram for the sample with S/N>20 in the two bands. For comparison, 
the distribution of U-band dropouts selected in GOODS-N is plotted with dotted line. 



B — z < 4.0, 
S/N B > 3 and S/N z > 3. 

We note that the number of U-band dropouts in GOODS -S is significantly less than that in GOODS-N, 
because the CTIO U-band image in GOODS-S is 1.5 mag shallower than the KPNO U-band image in 
GOODS-N. The physical properties of the U-band dropouts are measured in the same way used for the 
sVJL galaxies. 

In Figure [3l we overplot the redshift distribution of the U-band dropout sample (dotted line) selected 
from GOODS-N. The distribution peaks around z~3, being consistent with the expectation of LBGs, but 
significantly deviates from the peak of our sVJL sample. Since the offset between the peaks of the two 
samples is larger than 2a deviation of our photo-z measurement (Az/(1 + z) = 0.037), it is an intrinsic 
difference between the two methods rather than due to photo-z uncertainty. However, since the cosmic time 
interval between the two redshift peaks (250 Myr) is about 10 times less than the age of the universe at 
z~3 (~2.2 Gyr), we assume that the evolution of galaxies between the two redshifts is negligible. Under 
this assumption, any difference between the two samples is considered due to the fact that the two methods 
select galaxies with different physical properties rather than select galaxies with different redshifts. Also, 
in order to eliminate the effect of possible contamination, we only compare galaxies within the range of 
2.3 < z < 3.5 in the two methods. 

A direct and illustrative way to compare both methods is to study the location of the U-band dropouts 
in the (J-L) versus (V-J) plot. We match the U-band dropouts that are selected from GOODS-S TFIT 
catalog to the ERS TFIT catalog to measure their (J-L) and (V-J) colors. Figure 0] shows the positions of 
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Fig. 4. — Star-forming VJLs (points) and U-band dropouts (circles: z<3.2; squares: z>3.2) in the (J-L) 
versus (V-J) color-color diagram. Only U-band dropouts that fall into the ERS field are plotted. Both sVJL 
and U-band dropout samples have S/N>10 in J- and L-bands. 
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41 matched U-band dropouts (circles and squares) with S/N>10 in J- and L-bands in the (J-L) versus (V- 
J) diagram, together with sVJLs (points). We note that the U-band dropouts are scattered along the edge 
of our sVJL selection window. Among 41 U-band dropouts, 16 fall outside our sVJL selection window. 
Although photometric uncertainty could contribute to the scatter, we suspect that the primary reason is due 
to the different redshift distribution between sVJLs and U-band dropouts. As shown in Figure |3j the U-band 
dropouts have systematically higher redshift than sVJLs and is hence easier for them to be scattered out of the 
selection window. To examine our suspicion, we divide the U-band dropouts sample into two sub-samples: 
z<3.2 (circles) and z>3.2 (squares). 10 out of 16 (63%) U-band dropouts outside the sVJL selection window 
have z>3.2, suggesting that redshift is the main reason for these galaxies not being selected by our sVJL 
method. 

The other feature of U-band dropouts is more prominent and physical: no U-band dropout has J-L color 
redder than 2.0 mag. As shown in the left panel of Figure [Q CSF galaxies with E(B-V)>0.3 would have 
J-L color redder than 2.0 mag. Therefore, (J-L)>2.0 mag can be treated as a rough division for weakly and 
strongly obscured galaxies. The lack of red U-band dropouts confirms conclusions of previous studies that 



LBGs miss highly obscured galaxies (e.g., iBouwens et alJl2009l : iLy et al.ll201 ll : iRiguccini et al.ll201lb . On 



the other side, our sVJL method selects galaxies up to J-L around 3.0 mag, suggesting its ability to select 
highly obscured SFGs. 

The difference of the E(B-V) distributions of samples selected by the two methods can be clearly seen 
from Figure [5j where E(B-V) is measured from the slope of rest-frame UV continuum and plotted as a 
function of stellar mass of galaxies. Both samples have similar E(B-V) distribution in the stellar mass range 
of 9 < log(M/M Q ) < 10. But in the range of 10 < log(M/M Q ) < 11, their E(B-V) distributions differ: 
the distribution of U-band dropouts ends around E(B-V)=0.4, while that of sVJLs in the S/N>10 sample 
extends beyond E(B-V)=0.6. 

The two upper panels of Figure [6] show the cumulative fraction of number of galaxies as a function of 
E(B-V) in both stellar mass ranges for sVJLs and U-band dropouts. In the range of 9 < log(M/M Q ) < 10, 
both sVJL and U-band dropout samples have similar cumulative fraction curve and only contain galaxies 
with E(B-V)<0.4. In the range of 10 < log(M/M ) < 11, the U-band dropout sample still only contains 
E(B-V)<0.4 galaxies, while about 20% of sVJLs (in the S/NM0 sample) have E(B-V)>0.4. The E(B-V) 
distribution of massive (10 < log(M/M ) < 11) sVJLs drops quickly beyond E(B-V)=0.6 in the S/NM0 
sample (only 5% have E(B-V)>0.6). This could be attributed to two factors: (1) the real lack of very dusty 
SFGs at z~3 or (2) the sensitivity of the catalog detection band image of ERS (H-band) is not deep enough 
to detect these galaxies. Either way, we can still conclude that, compared to U-band dropout method, our 
sVJL selection method can select moderate dusty (E(B-V)<=0.6) SFGs at 2.3 < z < 3.5. 

We also note that the distribution of sVJLs in the S/N>20 sample is similar to that of U-band dropouts, 
even in the range of 10 < log(M/M Q ) < 11. This reflects that an overcut on the J-band S/N would reduce 
our ability to detect dusty SFGs at z~2.8. The S/N>20 sVJL sample also contains fewer low-mass (around 
10 9 M Q ) galaxies than the S/N>10 sVJL sample. This can also be attributed to the overcut on the L-band 
S/N in the latter. 
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Fig. 5. — E(B-V) distribution as a function of stellar mass for star-forming VJL galaxies (left) and U-band 
dropouts (right). Empty and solid circles in the left panels show sVJLs in the S/N>10 and S/N>20 samples, 
respectively. 
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Fig. 6. — Top: cumulative fraction of number of galaxies as a function of E(B-V) for sVJLs (thick solid for 
S/N> 10 and dotted for S/N>20) and U-band dropouts (thin solid) in two stellar mass ranges. Middle: cumu- 
lative fraction of SFR for sVJLs and U-band dropouts. Bottom: cumulative fraction of stellar mass for sVJLs 
and U-band dropouts. SVJLs and U-band dropouts in two stellar mass bins: 9.0 < log(M s tar/M ) < 10.0 
(left) and 10.0 < log(M star /M ) < 11.0 (right) are plotted. 
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4.4. Dusty Star-forming Galaxies 

Although red (J-L>2.0) sVJLs are likely to be dusty SFGs at z~2.7, a more careful census is needed to 
distinguish them from possible contamination. Specifically, PEGs at similar redshift have similar red rest- 
frame UV colors and hence can easily enter our sVJL sample due to photometric uncertainty In order to 
clean our dusty sVJL sample, we have to break the age-dust degeneracy, which, however, cannot be broken 
by simply using rest-frame UV and optical data. Fortunately, at z~2.7, the rest-frame 6 /xm emission from 
polycyclic aromatic hydrocarbons (PAHs), a feature of dusty SFGs, falls into the MIPS 24 /mi bandpass, 
and can help to separate dusty SFGs from PEGs. Any 24 fluxes that are significantly brighter than the 
prediction of pure stellar emission should be dominantly contributed by dust emission and hence indicate a 
high amount of dust in the galaxies. 

We match our sVJLs to GOODS-S MIPS 24 /mi catalog (see the description in Sec. l2!2l . with a 
matching radius of 1 .0" . Galaxies without MIPS 24 /mi counterparts are assigned a flux upper limit of 3 
/Jy, which is the upper envelope of the S/N-flux relation at S/N=l in our MIPS 24 /mi catalog. (However, 
we note that we do not use 24/mi sources with flux level of 3 /Jy for any scientific purpose. Sources with 
detection lower than 3<r should be treated with caution.) A potential issue of measuring MIPS 24 /mi flux of 
galaxies is the uncertainty raised by confusion and crowding. Our 24 /mi catalog over the GOODS-S field 
contains about 22,000 sources, deducing an average number density of 1.2 (4.8) sources in each circle with 
radius of 3" (6" ), which is 0.5 (1.0) times the FWHM of MIPS 24 /mi PSF This implies that 60% of light 
of a source is overlapping with the light of other sources. The PSF-fitting technique that we use to construct 
the catalog ideally reduces the influence to the lowest level by fitting nearby sources simultaneously. In this 
method, however, a slight oversubtraction (undersubtraction) of a bright source would result in a significant 
underestimation (overestimation) of fluxes of nearby sources. 

In order to evaluate whether MIPS 24 /mi fluxes are correctly measured, we compare our PSF-fitting 
fluxes to fluxes that are derived through aperture correction. In a crowding environment, aperture correction 
on the flux measured through the central region (e.g., within an aperture with size of 1 FWHM of PSF) 
of a faint object tends to overestimate its flux, since the central region of the object could be polluted by 
the light of its nearby sources. In this case, the aperture corrected flux can be used as an upper limit. To 
obtain a conservative estimation of the contribution of dusty SFGs to the cosmic SFRD, we care more about 
sources whose fluxes are overestimated by PSF-fitting than those whose fluxes are underestimated, as the 
former could be PEGs but misclassified as dusty SFGs. Such misclassification would result in a severe 
overestimation of their SFR and hence their contribution to the SFRD. For this purpose, any sources whose 
PSF-fitting fluxes are significantly larger than their aperture corrected fluxes are thought to have incorrect 
PSF-fitting fluxes, and aperture corrected fluxes will be used for them. 

Figure|7]shows the comparison between aperture corrected fluxes and PSF-fitting fluxes for sVJLs with 
E(B-V)>0.4. For sources with PSF-fitting fluxes larger than 40 /Jy, fluxes derived by both methods are in 
good agreement. This is not surprising though, as both methods are robust for bright sources. For source 
with PSF-fitting fluxes less than 10 //Jy, aperture correction overestimates their fluxes due to the issue of 
confusion and crowding, as these sources are faint sources around bright sources. We use the PSF-fitting 
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Fig. 7. — Comparison of MIPS 24/mi fluxes derived through PSF-fitting and aperture correction for sVJLs 
with E(B-V)>0.4. The solid line shows one-to-one correspondence, while dotted line shows zero aperture 
corrected fluxes. Since a few sources have negative aperture corrected fluxes, we only use logarithmic scale 
for PSF-fitting fluxes. 

fluxes for these sources, as they are the best solution we can have for them. For sources with PSF-fitting 
fluxes between 10 /iJy and 40 /xJy, particularly of our attention is one source whose aperture correction flux 
is less than zero but whose PSF-fitting flux is larger than 10 /iJy. As we discuss above, the incorrectly high 
PSF-fitting flux of this source is due to the under-subtraction of its nearby bright sources. We will mark this 
problematic source in later analysis. 

Figure [8] shows the 24 fim fluxes of our sVJLs as a function of stellar mass. For simplicity, we only 
plot sVJLs with E(B-V)>0.4 and 2.3 < z < 3.5. Over-plotted (black lines) in the figure are the predictions 
of the 24 fim flux-stellar mass relation for dust-free SSP models at z~2.7, with age of 0.5, 1.0 and 2.0 Gyr 
(from top to bottom). Galaxies with 24 fim fluxes significantly brighter than the prediction of SSP models 
are thought to be dusty SFGs, because their 24 /xm fluxes cannot be explained by pure stellar emission 
and hence should be contributed by PAH emission. On the other hand, galaxies whose 24 fim fluxes are 
consistent with the predictions of SSP models are thought as contamination. We also mark the galaxy with 
problematic PSF-fitting flux with squares in the figure. If the problematic galaxy is treated as a PEG, the 
fraction of contamination is about 18% (2 out of 11). This result is encouraging, as it shows our sVJL 
method can select dusty SFGs with a low level of contamination. 

Another possible source of contamination in our dusty SFGs is from AGN host galaxies. The warm dust 
around AGN can absorb and reprocess the energetic photons of AGN into IR emission that can be observed 
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Fig. 8. — MIPS 24 /im fluxes of dusty sVJLs (S/N>10) as a function of stellar mass. Here we only show 
galaxies with E(B-V)>0.4 and 2.3 < z < 3.5. Error bars show the photometric uncertainties. Three solid 
lines show the prediction of z~2.7 PEGs with age of 0.5, 1.0, and 2.0 Gyr. The square shows the source 
with possibly problematic PSF-fitting flux. 
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in the MIPS 24 fim channel. We use the Chandra deep 4Ms X-ray image of CDFS| to study the possible 
AGN contamina tion. None of our nine dusty SFGs is individually detected in the 4Ms Chandra catalog of 



Xue et all (1201 ll) . The stacked hard X-ray image of them also reports a detection comparable to the noise 



level. However, the stacked soft X-ray image has a detection of 3.5o\ The soft detection may indicate 
that our dusty SFG sample is contaminated by AGN host galaxies. However, using the stacked image, we 
measured a hardness ratio of ~- 1 , which is softer than the predicted hardness ratio of even the least absorbed 
AGN model (column density Nh = 10 21 cm~ 2 ) at z~3 in lWang et all (|2004). The ultra-soft spectrum of the 
stacked image implies that our dusty SFG sample is not heavily contaminated by AGN. We also calculate 
an average luminosity from the stacked soft-band X-ray images, using a mean redshift of 2.7. The mean 
luminosity is 1.2 x 10 42 erg/s, with the lower and upper limits from the Pois son uncertain t y on n et counts 
of 8.3 x 10 41 erg/sand 1.5 x 10 42 erg/s. If we use the SFR-X-rav relation of iRanalli et all i2003h: Lx/SFR 
~ 10 40 erg/s/(M Q /yr), we get an average SFR of about 100 M yr _1 . This value is consistent with the 
SFR measured through the rest-frame UV continuum of these galaxies. These galaxies are heavily obscured 
and occupy the high SFR end of the whole star-forming VJL sample. Therefore, we conclude that they are 
compatible with being star forming. 



4.5. Contributions of Dusty Star-forming Galaxies 

One of our motivations of selecting dusty SFGs around z~3 is to evaluate their contribution to the num- 
ber density, stellar mass density, and SFRD of SFGs. A precise measurement of the absolute contributions of 
dusty SFGs relies on the accurate correction of the incompleteness of the sample, which is a function of the 
redshift, surface brightness, color, and spectral types of galaxies. The best way to measure the incomplete- 
ness is simulating the detection ability of galaxies with different physical properties and multi-wavelength 
photometry. We leave such simulations to a future paper. Instead, in this paper, we try to estimate the rel- 
ative contributions (compared with those of low-dust galaxies) of dusty SFGs to the above quantities to the 
first-order accuracy. 

In our sVJL method, both low-dust and dusty galaxies are selected with the same color criterion from 
the same catalog. They are also aiming to the same redshift range. As a result, the two main factors that 
determine the selection incompleteness, namely, redshift and surface brightness limit of the survey, are 
roughly same for both low-dust and dusty sub-samples. We can assume that, to the first order, incomplete- 
ness is roughly same for both sub-samples. Therefore, the ratio of total numbers, SFRs, and stellar masses of 
both sub-samples should be immune to the incompleteness and accurate to the first order even no correction 
on incompleteness is applied. We acknowledge that the redder color and fainter rest-frame UV photometry 
of dusty galaxies may vary the selection incompleteness. However, both factors tend to increase the incom- 
pleteness of dusty SFGs so that our derived ratio is a conservative estimation of the contributions of dusty 
SFGs. 



2 http://cxc.harvard.edu/cda/Contrib/CDFS.html 
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Based on above discussion, a simple way to measure the relative contributions of low-dust and dusty 
sub-samples is to study the cumulative number, SFR and stellar mass as functions of dust extinction E(B- 
V). Since E(B-V) has a loose relation with stellar mass (see Figure [5), we study sVJLs in two stellar mass 
ranges separately: 9 < log(M/M Q ) < 10 and 10 < log(M/M Q ) < 11. We plot the cumulative curves of 
number (top panel), SFR (middle), and stellar mass (bottom) of our S/N>10 and S/N>20 sVJL samples 
in Figure [6l together with the curves of the U-band dropout sample as a reference. For galaxies with 

9 < log(M/M ) < 10 (left column), sVJLs (in both S/NMO and S/N>20 samples) have similar cumula- 
tive curves with U-band dropouts, simply because there are almost no dusty (E(B-V)>0.4) galaxies detected 
in this mass range, as shown by the left panel of Figure [5] The situation is same for S/N>20 sVJLs in the 

10 < log(M/M Q ) < 11 range (right column), as the overcut on the J-band S/N reduces our ability to detect 
dusty galaxies. The significant difference comes from the S/N>10 sVJLs, whose cumulative SFR curve 
obviously deviates from that of other samples in the 10 < log(M/M Q ) < 11 range. About 50% of SFR 
is contributed by galaxies with E(B-V)>0.4, although these dusty galaxies only contribute about 20% to 
number and 20% to stellar mass of galaxies in the mass range, as shown by the top right and bottom right 
panel of this figure. 

An alternative way to evaluate the importance of dusty SFGs that are selected by our sVJL method is to 
compare their contributions (on number, SFR, and stellar mass densities) to those of U-band dropouts. The 
comparison again relies on the accurate measurements of the incompleteness of the two selection methods, 
but can be compromised through the following way. We choose a certain population of galaxies that is 
highly completely selected by both methods so that its three densities measured with both samples should 
be same even when no correction on incompleteness is applied to this population. We then normalized the 
densities of other populations in both samples to those of this population. The normalized density distri- 
butions hence show the relative contributions of each different populations in the two samples. We choose 
galaxies whose E(B-V)s are within ±0.05 of the median E(B-V) of each sample as the "complete" sub- 
sample. In the stellar mass bin of 9.0 < log(M sta r/M0) < 10.0, this sub-sample consists of galaxies with 
0.05 < E(B - V) < 0.15 for both U-band dropouts and sVJLs, while in the 10.0 < log(M star /M ) < 11.0 
bin, galaxies with 0.15 < E(B - V) < 0.25. 

The comparisons of normalized number density (top), SFRD (middle), and stellar mass density (bot- 
tom) of U-band dropouts (thin lines) and S/N>10 sVJLs (thick lines) as a function of E(B-V) are shown in 
Figure |9l The same information of Figure [6l that about 20% to 30% of number density and about 50% of 
stellar mass and SFR densities in sVJLs at high mass end (10.0 < log(M sta r/M0) < 11.0) are contributed 
by galaxies with E(B-V)>0.3, can be inferred from this figure. However, an important point of Figure [9] is 
that the densities of low-dust (E(B-V)<0.3) galaxies in the two samples are quite similar in both stellar mass 
bins, with an only ~ 10% excess from the sVJL sample, which demonstrates that although the cumulative 
distributions are different in the high-mass end of the two samples, our sVJL method has the same ability 
to select low-dust galaxies as the U-band dropout method, in terms of the three densities. The ~50% of 
contributions to stellar mass and SFR densities of dusty SFGs in our sVJL sample are "net" contributions, 
instead of due to the possibility that low-dust galaxies are largely missed in our sVJL sample. 

Our results, along with some recent studies, highlight the importance of counting SFR from dusty 
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Fig. 9. — Top: comparison of normalized number density (top), SFRD (middle), and stellar mass density 
(bottom) of U-band dropouts (thin lines) and S/N>10 sVJLs (thick lines), as a function of E(B-V). All 
densities are normalized to E(B-V)=0.1 for the stellar mass bin of 9.0 < log(M star /M0) < 10.0 and to 
E(B-V)=0.2 for 10.0 < log(M sta r/M ) < 11.0 (dotted-dashed lines). Error bars in top panels show the 
Poisson errors, while those in other panels show how the Poisson error propagates into each quantity by 
assuming an average stellar mass and SFR for each galaxy. 
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galaxies, which occupy the high SFR (and massive) end in the SFR-stellar mass plane, when calculating 
the cosmic SFRD. These galaxies are usually faint or even undetecte d in observed U V band at z~3 and 
could be missed by UV only selection (e.g., Lyman break technique). iLy et al.1 (1201 lh carried out a census 
of SFGs at z = 1-3 in the Subaru Deep Field, where good statistics and accurate measurements of photo-z 
and physical properties are enabled by a large sample (~53000 galaxies) and 20 band (1500 A - 2.2 fim) 
photometry. They compared the selection results of BzK, LBG, and BX/BM, and found that among z=l-2.5 
galaxies in their census, 81%-90% of them can be selected by combining the BzK selection with one of the 
UV techniques (z~2 LBG or BX and BM). What is more important, they found that for galaxies brighter 
than K>24 AB (roughly corresponding to log(M/M Q ) > 10 for SFGs at z~2), 65% of the star formation 
in them are contributed by galaxies with E(B-V)>0.25, even though they are only one-fourth of the census 



YunetaL 



by nu mber. Their results are in very good agreement with ours, although aiming to lower redshift. 
fill) studied the rest-frame UV and optical properties of sou rces detected by the deep 1.1 mm wavelength 
imaging of the GOODS-S by AzTEC/ASTE Jscott et all201ol) . They claimed that although not all sub-mm 
galaxies are faint and red in their rest-frame UV and optical bands, the majority of the AzTEC GOODS 
sources, which have a median redshift of 2.6% and 80% of which are at z>2.6, are too faint and red to have 
been identified in previous surveys of SFGs and are likely be entirely missed in the current measurements 
of the cosmic SFRD. 



5. Passively Evolving VJL Galaxies 

In this section, we apply Eq. |2]to the ERS field to select PEGs at z~3. With a concern that a high S/N 
threshold in rest-frame optical band would exclude real PEGs from our sample, we tune down the threshold 
to S/N>5 in both J- and L-bands. However, we still construct samples with S/N>10 and 20 to provide 
a reference on how photometric uncertainty affects our selection results. We find 32, 27, and 13 galaxies 
falling into our pVJL selection window for S/N>5, 10, and 20. However, as shown in Figured! both low- 
z and high-z dusty SFGs also enter our pVJL selection window so that a fraction of our pVJL selected 
galaxies may not be real passive and old galaxies, but rather dusty SFGs. We will estimate the fraction of 
contamination in our pVJL sample and discuss how to clean the sample. 



5.1. Clean Sample 

As similar as in ^4.41 we use MIPS 24 fim flux to help identify contamination in our pVJL sample. 
Galaxies whose observed 24 fim fluxes are 3a higher than the prediction of a dust-free passively evolving 
model (SSP with age of 2 Gyr) with the same redshift and stellar mass are considered as contaminating dusty 
galaxies, because their 24 fim fluxes cannot be explained by pure stellar emission and hence are dominated 
by dust emission. The same issue we face here is again the confusion and crowding of MIPS 24 fim image. 
We repeat the same test in Sec. !4.4l to compare PSF-fitting and aperture corrected fluxes. We use the aperture 
corrected fluxes for sources whose PSF-fitting fluxes are larger than the la confidence level of their aperture 
corrected fluxes, and use the PSF-fitting fluxes for other sources. 
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Comparing the observed 24 /mi fluxes of our pVJLs with stellar models, we find the contamination 
fraction of 59%, 59%, and 77% for samples with S/N cuts of 5, 10 and 20. The fraction does not decrease 
with the increase of S/N thresholds, suggesting that simply increasing the S/N cuts cannot help clean our 
pVJL sample. This is because such contamination is due to the intrinsic deficit of our selection method 
(as shown by the left panel of Figure \T\ where a few tracks of dusty SFGs also enter our pVJL selection 
window) rather than due to photometric uncertainty. Moreover, the fraction of contamination is very high 
in all samples. This is not surprising though, because the number density of PEGs is expected to be low at 
such high redshift so that a small absolute number of contamination can occupy a relatively large fraction of 
the sample. 

An additional condition must be applied to remove contamination from our pVJL sample. Although 
observations at longer wavelength, such as MIPS and Herschel data, can readily help identify the contam- 
ination of dusty galaxies, we attempt to restrict our selection criterion to using only V-, J- and L-band 
information so that the method can be easily applied to large surveys where deep observations at longer 
wavelengths may not be available. What is more important is that using only the three-band information 
enables a relatively easy multi-wavelength Monte Carlo simulation, which is essential to understand the 
systematics and bias of our selections. In this study, longer wavelength observations are only used to help 
calibrate and optimize our selection method. 



A possible way to clean the sample is to examine the rest-frame optical size of galaxies. ICassata et al. 



(|201 lh show that the fraction of compact galaxies in PEG samples increases with redshift. At z~2, about 
70% of PEGs are compact. Extrapolating their relation to z~3, we expect more than 90% of PEGs to have 
small size. If this expectation is true, galaxies with no 24 /im detection is low should tend to have small 
radius and vice verse. 

Figure [10] confirms our speculation by showing the relation between the significance of 24 /mi flux 
and J-band Kron radius. In the S/N>5 sample, 85% of galaxies whose MIPS 24 /mi fluxes are within 3a 
deviation of a pure passive stellar emission have J-band Kron radius less than 1". On the other side, 84% 
of galaxies with significant 24 /mi fluxes, an indicator of dust emission, are larger than 1" in terms of Kron 
radius. This interesting finding of the relation between MIPS 24 /mi flu xes and galaxy sizes is a reflection 
of the size-star formation relation of massive galaxies at z > 2 (e.g., Zirm et al. 2007 : Toft et all l2009n 



and suggests that using size can effectively distinguish real PEGs from dusty SFGs. Moreover, in the small 
size (rxron < 1" ) sample with S/N>5, only 2 out of 14 galaxies have significant 24 /mi fluxes. Therefore, 
based on the high efficiency and low contamination of using small size to select PEGs, we add the condition 
rKron,j <1" to our pVJL criterion (Eq. [2]). After this extra condition being applied, our samples now contain 
14, 10, and 2 galaxies with S/N cuts of 5, 10, and 20. And the contamination level is reduced to 14%, 10%, 
and 0% in the three samples. 

The redshift distributions of galaxies in our final pVJL samples (solid lines) are shown in Figure QT] 
Comparison between samples with (solid lines) or without (dotted lines) the size criterion shows the effi- 
ciency of the additional size criterion on removing contamination from low redshift (z<2.0). The redshift 
distribution of our final sample peaks around z~2.5 regardless the applied S/N cut. This distribution is a 
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Fig. 10. — Deviation of MIPS 24 fim fluxes of pVJLs from the predication of pure stellar emission as a 
function of Kron radius. Galaxies with different S/N cuts are shown with different point sizes, as labels 
show. The dotted lines show ±3cr deviation from the prediction, and the solid line shows the extra criterion 
(rKron,j < 1" ) that we add to our pVJL selection method. 



Table 3: Passively Evolving Candidates at z>3 



ID 


R.A. 


Decl. 


Photo-z E(B-V) 


Z 


Age 


T M s tar 


SFR 




J2000 


J2000 






Gyr 


Gyr Log(M*/M ) 


M /yr 



2318 


53.07387680 


-27.72217050 


3.43 


0.00 


0.004 


1.00 


0.1 


10.54 


0.04 


2414 


52.99881320 


-27.72097790 


3.08 


0.00 


0.020 


0.80 


0.1 


10.56 


0.27 


2454 


53.06628720 


-27.72043590 


3.35 


0.00 


0.020 


0.80 


0.1 


10.28 


0.14 


3222 


53.10302370 


-27.71234920 


4.52 


0.65 


0.004 


0.02 


99.99 


10.55 


1.87E+03 


5218 


53.17444360 


-27.69261340 


4.56 


0.05 


0.050 


0.50 


0.1 


10.46 


4.33 


8124* 


53.14818030 


-27.71810980 


4.81 


0.00 


0.050 


0.50 


0.1 


10.21 


2.44 



"The K-band image of this source is very faint so that TFIT likely has difficulty to measure reliable photometry for it. TFIT 
measures a negative flux with a large error bar. We carried out an aperture photometry with the aperture size of 1 .0" and got a flux 
of 0.23±0.11 fily. This is broadly consistent with the prediction of the best-fit SED (solid line in Fig. I12t . We note that we did 
not include the K-band in the SED-fitting because of the negative TFIT flux. We also note that the marginal (1.3<r) detection of 
the source in K-band is somehow due to the lower sensitivity of the K-band image in this tile. The 5a limiting magnitude of this 
tile is 24.28 AB, while its la limiting magnitude is 26.03 AB. Our aperture photometry (0.23 /iJy, namely 25^50 AB) is broadly 
consistent with an about 2a detection. 
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Fig. 11. — Redshift distributions of pVJL selected galaxies. Different panels show cases with different S/N 
cuts, as labels show. Dotted lines show the distributions of galaxies selected only through Eq. [2j while solid 
lines show the distribution of galaxies that satisfy both Eq. [2]and the size criterion (rxron <1" )■ 



little lower than our expectation (z~3.0) but consistent with our previous analysis based on the color of 
stellar population synthetic models. As shown by the dotted line with squares in the left panel of Figure 
CD the track of SSP galaxy with t=1.0 Gyr begins to enter our pVJL selection window at z~2. Although 
the track stays in our pVJL selection window at higher redshift, the number density of PEGs is expected to 
decline with redshift. As a result, it is not surprising that the redshift distribution peaks at a point where the 
number density of galaxies is still high and the photometric uncertainty cannot easily scatter galaxies out of 
the selection window. 



5.2. Passively Evolving Galaxies at z>3? 



Recently, PEGs are occasionally found at z>3 (e.g., iMancini et all 120091 : LMarchesini et all l2010l) . 
These galaxies contain important information of when and how galaxies stopped their star formation ac- 
tivity. Their number density, or even their existence itself, can set strong constraints on current theories of 
galaxy formation and evolution. Six galaxies in our S/N>5 sample are at z>3. Although they do not enter 
our S/N>20 sample because of the low S/N of their rest-frame optical photometry, it is still intriguing to 
study their physical properties and examine if they are real PEGs at z>3. 

Table [3] summarizes the best-fit parameters of the six high-z PEG candidates. The ages of five galaxies 
are significantly (at least five times) older than their characteristic star-formation time-scale (r), suggesting 
that they have already passed their star-formation peaks and become quiescent. Only one galaxy (ID 3222) 
is fitted as a dusty star-burst galaxy with SFR > 1000 M Q /yr. Although the best-fit parameters support the 
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passive natures of the majority of our candidates, the SED-fitting procedure, which only uses the rest-frame 
UV to NIR data, suffers from the age-dust degeneracy and is hence not capable of perfectly distinguishing 
dusty star-forming and old populations. If we assume that these galaxies are forming stars and that their red 
rest-frame UV colors are caused by dust obscuration rather than old stellar populations, their E(B-V)s and 
obscuration corrected SFRs measured from their rest-frame UV continuum slopes would be much higher 
than the SED-fitting derived values, with all E(B-V)s>0.3 and SFR on average a few hundred times higher 
than the best SED-fitting values. Such high E(B-V)s and SFRs together suggest that these galaxies should 
have significant dust emission exists in longer wavelength (e.g., rest-frame IR and sub-mm), where dust 
emission dominates the radiative spectrum, if their dusty star-forming nature is true. 

Figure [12] shows the best-fit stellar population SEDs (solid line) of the six gal axies. For comparison , 



we also plot templates of the SFGs (dotted line) retrieved from the templates of IChary & Elbaa ((2001). 
The star-forming templates are not chosen by fitting to rest-frame UV and optical data to models. Instead, 
we calculate the obscured SFR (total SFR minus unobscured SFR) of these galaxies from their rest-frame 
UV continuum, assuming they are dusty SFGs. Then, for each galaxy, we convert the obscured SFR to 
the bolometric IR luminosity and choose the template whose bolometric IR luminosity best matches the 
luminosity of the galaxy. It is interesting to find from the plot that although we do not fit the templates to 
the rest-frame UV and optical data, the templates match the data fairly well (except Galaxy 3222). The best 
chosen template gives us an estimate of the fluxes from dust emission, which, if existing, can be observed by 
our current MIPS 24 /mi, GOODS-Herschel (PI Elbaz) 100 and 160 jum, and AzTEC 1.1 mm observations 



dScott et al.lboioh . 



At such high redshift, dust emission within the MIPS 24 /im bandpass is still comparable to the stellar 
emission, as the stellar emission peak is just a little blueward of the MIPS bandpass. As seen from the plot, 
in four out of six galaxies, the MIPS 24 /mi fluxes cannot help distinguish old and dusty populations at all. 
In two galaxies (2414 and 2454), the observed 24 /im fluxes lean toward the prediction of dust emission, 
however, the prediction of pure stellar emission is still within the 3a level of the observation and cannot be 
fully ruled out. 

In principle, GOODS-Herschel and AzTEC data can be effective at distinguishing PEGs from dusty 
SFGs by sampling the blackbody radiation of cold dust. Unfortunately, the detection thresholds of these 
surveys are so high that the fluxes of dusty templates in Figure [12] are almost all under their la detection 
limits. Indeed, flux measurements of individual galaxies in the AzTEC image suffer from a very low S/N, 
< la, being comparable to the noise level. Due to the high detection thresholds, we cannot conclude 
that if the non-detections in the AzTEC image provide a tight constraint on the nature of our candidates. 
However, as shown in the figure, the predicted dust emission from three or four dusty star-forming templates 
is touching the la detection limit of these long- wavelength bands. We expect an at least a 2a detection in 
the stacked images if all our galaxies are dusty SFGs. In the stacked AzTEC image, we detect a signal 
with S/N=l.l in the central pixels (with size of 3"), still comparable to noise. Such low S/N in the stacked 
AzTEC image suggests that at least some of our candidates are not dusty SFGs but real PEGs at z>3. It also 
rule out our suspicion that Galaxy 3233 has SFR over 1000 M /yr, as its best SED-fitting shows in Table[3] 
Such huge SFR should have been easily detected in the AzTEC image. 
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Fig. 12. — Observed and best-fit SEDs for six galaxies at z> 3 in our S/N>5 pVJL sample. Open circles 
with error bars are fluxes and their uncertainties that are used for SED-fitting. Stars with error bars show 
the MIPS 24 fim fluxes and 3a uncertainties. Arrows show the la dete ction limits of GOODS-Herschel (PI 
Elbaz) 100 and 160 /im and AzTEC 1.1 mm images Jscott et alJboioh . MIPS, Hershel and AzTEC points 
are not use d for SED-fitting. Th e best-fit models are shown by solid lines. Dotted lines are reference model 
of SFGs of Icharv & ElblJ(l200lk 
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We also use the Chandra deep 4Ms X-ray image of CDFS to examine if AGN host galaxies contaminate 
our PEG candida tes at z>3. None of our candidates is individually detected in the 4Ms Chandra catalog of 



Xue et al.l (120111) . The stacked images in both soft and hard bands show signals comparable to noises, with 
an S/N of 1.75 and 1.17, respectively. We conclude that our PEG candidates at z>3 are not contaminated 
by AGN host galaxies. 

We note that the two galaxies with the highest redshifts (5218 and 8124) have the largest SFRs. Their 
best-fit SFRs are comparable to that of our Milky Way, while their stellar masses are lower than that of Milky 
Way. The SSFR of these galaxies are higher than 10~ n /yr, the usual value used to distinguish SFGs and 
PEGs. We suspect that it is possible that although these galaxies have passed their peaks of star formation, 
their star formation activity has not yet been fully ceased. They could be in a transition stage from star 
forming to fully quiescent, since their rest-frame UV and optical light is already dominated by old stellar 
populations. At lower redshift (z<3.5), galaxies all have SSFR less than lCP n /yr, very well fit to the usual 
criterion of PEGs. We speculate that galaxies in the universe begin to transit from star forming to quiescent 
stages at z~4.5 and become fully ceased PEGs at z~3.5. However, the fact of increasing SFR with redshift 
could also be due to a selection effect of a flux-limited sample, because SFR increases with luminosity so 
that galaxies with higher SFRs can be observed out to higher redshift. Deep and large NIR band survey, 
such as CANDELS, is required to observe galaxies down to a fainter luminosity (hence lower SFR) level to 
provide a more accurate SED-fitting results to reveal the secret of when galaxies began to cease their star 
formation. 



5.3. The Evolution of Integrated Stellar Mass Density of Passively Evolving Galaxies 



The integrated stellar mass density (ISMD) of PEGs is a key parameter for understanding the formation 
and evolution of the galaxies. It quantifies how many stars have been locked in passive systems at a given 
cosmic epoch. Currently, most studies on the evolution of stellar mass function and stellar mass density 
focus on all (both star-form ing and passively e volving) massive ga l axies at z>2 (e.g . , [F ontana et al. 2006; 



Cassata et al 



Marchesini et all2009l .l201ol). Only few works jMancini et al.ll2009l : Elbert et alJboiolJBrammer et al 



2011 



2011 ) have been devoted to the study of the evolution of PEGs (or quiescent galaxies) only, 



partly due to the difficulty of identifying these galaxies at high redshift. However, the evolution of the 
passive population only is as important as that of all populations together, because it records when and how 
stars migrate from the star-forming population to passive population, which are critical for us to understand 
the physics that governs the ongoing and ceasing of star formation activity in the universe. 

In this section, we estimate the ISMD at 2<z<3 using our clean pVJL samples. The precise measure- 
ment of the function should be obtained by integrating the stellar mass function, either the analytic Schechter 
form or the stepwise one. However, our small number samples (only 14 pVJLs even in the S/N>5 sample) 
limit our ability to obtain an accurate measurement of the stellar mass function at 2<z<3. We leave such an 
accurate measurement to a forthcoming paper (Y. Guo et al. in prep.) that employs the advantage of the large 
survey area of the upcoming CANDELS. In this paper, instead, we simply carry out a shortcut measurement 
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of the ISMD to its first-order accuracy. 
We calculate the ISMD as follow: 



/ / MN obs (M, z)C(M, z)dzdM 

7¥^ " 



(5) 



where M is the stellar mass, N j, s (M,z) is the observed number of galaxies with stellar mass M and 
redshift z, and is the differential cosmic volume at z. The lower and upper limits of the integral over 
z are 2 and 3, while the lower limit of the integral over M is 10 10 M©. C(M, z) is a factor to correct the 
incompleteness caused by observation and selection for galaxies with M and z. As referred from Figure [TT1 
the redshift distributions of our pVJL samples are very well peaked around z~2.5 and have a narrow scatter. 
Therefore, it is safe to assume that C(M, z) is primarily dominated by M and only has a weak relation 
on z in our sample. We choose z=2.5 for calculation C(M, z) for all pVJLs. The uncertainty induced by 
such an assumption is less than that induced by the measurement of stellar mass of galaxies. Under this 
assumption, we place an SSP model with age of 1 Gyr and stellar mass M at z=2.5 and perturb its V-, J- and 
L-band photometry using Gaussian random deviation with the variance set equal to a photometric error that 
is randomly drawn from the distribution of observed photometric uncertainties for a given magnitude of a 
given band in our multi-wavelength catalog. The perturbation is repeated 1000 times and for each time we 
justify whether the perturbed galaxy can be selected as a pVJL according to our criterion, Equation 12 and 
different S/N cuts. The factor C(M, z) is defined the reciprocal of the rate of successful selections. 

The ISMD of our pV JLs at 2<z<3 i s shown in Figur e [T3l together with measurements for lower 
redshift from other studies (|Bell et al.ll2003 : Borch et al. 2006 ). We measure the ISMD for each of our three 
samples with different S/N cut and plot the mean and standard deviation of the three samples. As shown by 
the filled point with error bars at z~2.5, the la deviation of the three samples is about 0.2 dex, comparable 
to the typical stellar mass uncertainty obtained through SED-fitting at such redshift. The small deviation 
also demonstrates that the incompleteness is fairly accurately estimated for our samples so that the ISMDs 
of samples with different mass limits that are induced by different S/N cuts are in very good agreement. 

To further test the reliability of our measurement of the ISMD, we apply our method to galaxies that 
are se lected from GOODS-S using the passively evolving criterion of the BzK method (pBzK; 



Daddi et al. 



2004 a|). The redshift distribution of pBzKs peaks at z^l.5, where a number of m easurements of the ISMD 



dllbert et al.ll201Q : ISaracco et alj|20ld : iBrammer et al.ll201 ll : ICassata et al.ll201 lb can be used as references 
to test the accuracy of our measurement. For pBzKs, we choose an SSP model with age of 2 Gyr at z=1.5, 
perturb its B-, z- and K-band photometry according to photometric uncertainties, and calculate the ISMD 
with the same formula as we use for pVJLs. We also calculate the ISMD using three pBzK samples with 
different S/N thresholds at z- and K-bands (S/N>5, 10, and 20). Thanks to the relatively large number 
of galaxies in each sample, the ISMD of different pBzK samples agree with each other better than that of 
different pVJL samples, with the standard deviation less than 0. 1 dex. 

Figure [T3l illustrates the evolution of the ISMD of PEGs from z>3 to z=0. We compile measure- 
ments of several previous s tudies and comp ar e them with our r es ults. In particular , we take the best- 
fit Schechter parameters by Bell et all (|2003t ): Borch et all ((20060 : lllbert et all (|2010l) and integrate their 
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Fig. 13.— Evolution of ISMD for PEGs with M star > 1O 1O M . Results of different works are shown by 
different symbols. The evolution can be schematically divided into three stages, as indicated by the two 
vertical dashed lines. The two solid lines are the best fit to the evolution of ISMDs of l<z<3 and z<l. 
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Schechter functions down to mass limit M* > 10 10 M Q . We also take the ISMD listed in the tables of 



Saracco et al 



(2010) and iBrammer et all (1201 lh . The ISMD of PEGs at 1.3<z< 2.0 in HUDF meas ured 



by iDaddi et all (120051) and the measurement from one of our companion paper (iCassata et all 1201 11) are 
also plotted. All adopted measurements are scaled to match our Salpeter IMF with the following relations: 
log(M Sa i pBter ) = logfM rn j.R^I + 0.24 dsalimbeni et alJ2009bh and log(M Salpeter ) = log(M Kr0 upa) + 0.20 



(|Marchesini et all |2009). 



Salimbeni et al 



(2009 b|) also compared stellar masses measured with different 
stellar synthesis libraries, i.e., BC03, CB09. and lMaraston (2005, hereafter M05) and found the following 
relations: log(McB09) = log(MMos) at all redshift; log(McB09) = log(MBC03) + 0.20 at z<1.5; and 
log(McB09) = log(MBcos) + 0.10 at 1.5<z<4. We use these relations to scale stellar masses in other 
works to CB09. 



Our ISMD at z~1.5 (pBzK) agrees well with that of quiescent galaxies of llibert et al.1 (|2010h . with 
differ ence less than 0. 1 d ex. However, our ISMD deviates from other studies at z~1.5 by a few tenth 
dex. ICassata et al.l (1201 ll) constructed a fairly complete and clean sample by using not only SSFR but 
also morphology and MIPS 24 /im flux. Their ISMD should suffer the least from incompleteness and 
contamin ation. However, their fie ld, namely the ERS field, is occupied by an over-dense l arge-s cale structure 
at z~1.6 (ISalimbeni et al.ll2009ah . which might boost the ISMD upward. IDaddi et all (120051) used only a 
small sample (six galaxies) over the 12.2 arcmin 2 HUDF area so that their result may suffer from both 
small number statistics and large cosmic variance . The scheme of separating quiescent and dusty SFGs 
by two rest-frame colors of IBrammer et all (1201 ll) may induce into their quiescent sample a fraction of 
dusty contamination, which could partly explain the largest ISMD at z~1.5 measured by them. Despite 
the discrepancy, ISMDs at z~1.5 measured by different authors scatter around the best fit of the evolution 
of ISMD of PEGs at l<z<3 (solid line in the plot) within ~0.3 dex, which is just slightly larger than the 
typical uncertainty of deriving stellar mass through SED-fitting at this redshift (~0.2 dex). This suggests 
that the uncertainty of stellar mass is the dominant source of ISMD uncertainty, and that our simplified 
incompleteness correction is accurate to the first order. 



Only our work and 



Brammer et al. 



(120111) measure the ISMD of PEGs at z~2.5. The ISMD of 
Brammer et al.l (|201 lh is 0.2 dex lower than that of ours, again within the typical unc ertainty of stellar mass . 
Besides the stellar mass uncertainty, the discrepancy could also be due to the fact that lBrammer et al" ( 2011 ) 
only integrate their stellar mass function at z>2.0 down to M* > 10 11 M Q , w hereas the stellar mass func 
tion o f PEGs is dominated by galaxies around M*, typically M* = 10 ia6 M Q (|Ilbert et allboiOtlPeng et al. 
20ld) . 



We even extend our measurement to z>3, where we only have a few PEG candidates though. We mea- 
sure the ISMD for three candidates at 3<z<3.5 using an SSP model of 1 Gyr at z=3.3 and the ISMD for the 
other three candidates at z>4 using an SSP model of 0.5 Gyr at z=4.5. Since there might be contamination 
of dusty SFGs among our candidates (as discussed in ^5.21) . the ISM Ds at z>3 can be on ly treated as an 
upper limit. The upper limit of ISMD at z>3 was also measured by iMancini et all (|2009l) . who found 21 
z>3.5 quiescent candidates which are selected at IRAC 4.5 /j,m channel but have no MIPS 24 fim detection 
in GOODS -N. As argued by them as well as indicated by Figure [l2j the lack of 24 fim emission is a neces- 
sary but insufficient condition for determining a galaxy to be quiescent. Our upper limit of ISDM at z>3 is 
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about 0.3 dex lower than that of theirs (also shown in Figure [T3l. but still within the error bars of their upper 
limit. In this sense, the two measurements are not inconsistent. 



5.4. Stellar Mass Locked in Passively Evolving Galaxies 
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Fig. 14. — Fraction of stellar mass locked in PEGs as a function of redshift. Results of different works are 
shown by different symbols. See labels in Figure[T3]for the meanings of symbols. 

The evolution of ISMD of PEGs can be easily converted into the evolution of fraction of stellar mass in 
PEGs, if an underlying global stellar mass density (GSMD) is measured for all types of galaxies. We obtain 
such a measurem ent by fitting a linear relation to the evolution of GSMD (log(GSMD) versus redshift) 
of Figure 12 of Marchesini et al. I i2009h . which compiles measurements of GSMD from several previous 
studies. We then divide the ISMD of PEGs by the GSMD at a given redshift to obtain the fraction of stellar 
mass in PEGs. 

The evolution of the mass fraction is shown in Figure [14] At z>3, the mass fraction of PEGs is less 
than 5%. This fraction then increases from 5% to about 40% from z=3 to z=l. H owever, there is la rge 
discrepan cy among measur ements of the fraction at z~2, from 5% of our study and lllbert et al.l (120101) to 
25% of lBrammer et all (1201 ll) . The reason of such large discrepancy, as discussed above in the measurement 
of ISMD, is complicated, possibly due to sample selection, stellar mass density measurement method, and/or 
cosmic variance. A more accurate measure is needed in future to constrain this fraction and hence the 
mechanisms that are responsible for quenching the star formation activity during the peak of the cosmic 
SFRD. It should also be noted that there is about 0.2 dex deviation for the GSMD at z~2 measured by 
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different authors (see Figure 12 of iMarchesini et all (120091) ). Therefore the accurate measurement of stellar 
mass fraction in PEGs requires an improvement on measuring the stellar mass densities of both PEGs and 
all types of galaxies. Our work does not provide measurement on the mass fraction at z<l, but we still plot 
the measurements of other authors for readers to obtain a sight of the evolution trend in lower redshift. 



5.5. Discussion 



The evolution of ISMD of PEGs can be schematically divided into three stages, as indicated by the 
vertical dashed lines in Figure [14] The physical mechanisms that govern the formation and evolution of 
PEGs in each stage may be different. 

The first stage (z>3) could be called as the formation (or present) stage. The existence of PEGs in the 
stage is still controversial (IMancini et al.ll2009l : IMarchesini et al.ll2010l) . In our study, we find six candidates 
at z>3. Individual and stack analysis of the sub-mm AzTEC images show that at least some of them could 
be really passive. We cannot, however, draw a firm conclusion on which one is real passive. If we treat the 
ISMD that we measured at z>3 as an upper limit, the ISMD grows by a factor of 10, or even larger in 1 
Gyr from z~4 to z~2.5. The existence of PEGs of age of 1 Gyr at z~3.5 suggests that these galaxies begin 
to form their stars at z>5 or 6. Due to the small sample and limited information, we cannot discuss the 
formation mechanism of these galaxies. Future studies in the following two aspects would shed a light on 
this question: (1) confirming or excluding the passive properties of our candidates by using other facilities 
and (2) exploiting larger and deeper NIR survey (e.g., CANDELS) to construct a large sample with a good 
statistics. 

The second stage (l<z<3) is the rapid growth stage, during which the ISMD of PEGs grows by a 
factor of 10 in 3.5 Gyr. Stars are extensively formed in or migrate d into passive systems in this period. This 
stage is coincident with the broad peak of the cosm ic SFRD (e.g., lHoplrinsll20ollHopkins & Beacomlbood : 
Perez-Gonzalez et al.ll2008l : IChary & Popell2010h . suggesting that the formation of stars and the migration 
of stars from star- forming systems to passive systems are happening simultaneously during this epoch. 
Cassata et all (|201ll) studied the size distribution of PEGs during this stage and found ~80% of PEGs at 
z~1.5 are compact. The mechanisms that are responsible for the rapid mass growth of PEGs (e.g., gas-rich 
major merger, collapse of unstable disks and monolithic collapse) also tend to produce passive remnants that 
are compact and small with respect to local early-type galaxies. 

The third stage (z<l) is the slow growth stage, during which the ISMD only increases by a factor 
of ~3 in ~7 Gyr. This suggests that the majority of PEGs has already been formed be fore this stage . 
This stage happens when the cosmic SFRD begins to rapidly decline from its peak (e.g., lHopkinsll2004l : 
Hopkins & Beacomll2006l : IPerez-Gonzalez et alJl2008l : IChary & Popdl2010n . indicating that newly formed 
stars may not be enough for explaining the steady growth of the passive systems from z=l to z=0. It requires 
stars that already formed in other systems to migrate into the passive syst ems. A joint analys is of stellar 
mass density, number density, and size distribution of PEGs in this stage by lCassata et al. ( 2011 ) found that 
the number density increases by a factor of 1.5 from z=l to z=0.5, while the ISMD keeps almost constant 
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at the same time. And the average size of PEGs increases by a factor of about 2.5 in the same epoch. 
These findings imply that the mechanisms that increase PEGs' sizes during this redshift ra nge would not 
significantly increase their stell ar masses, most likely being minor merges and slow accretion Jllopkins et al. 



2008: Ivan Dokkum et al.ll2010f) . Also, the newly formed PEGs that increase the number density at this time 



would have small stellar masses and larger sizes than those formed at z<l, indicating a different formation 
mechanism. 



6. Summary and Conclusions 

In this paper, we introduce a new method of selecting both SFGs and PEGs at 2.3 < z < 3.5 using 
rest-frame UV-optical (V-J versus J-L) colors. We apply our VJL criteria to select galaxies in the WFC3 
ERS field and study the physical properties of the selected galaxies. We also discuss the implications of our 
selected galaxies on galaxy formation and evolution, especially the contribution of dusty SFGs to the cosmic 
SFRD at z~3 and the evolution of ISMD of PEGs. The paper is summarized below. 

Our VJL criteria are thoroughly tested with theoretical stellar population synthesis models and real 
galaxies with spectroscopic redshifts. The tests show that our criteria for SFGs (Equation [T] sVJL) is able 
to select galaxies with constant or exponentially declining SFH independently of their dust reddening. Our 
criteria for PEGs (Equation^ pVJL) can select galaxies with properties similar to SSP models around z~2.5 
and above. The tests also show that, however, (1) the main source of contamination in our sVJL sample is 
the SFGs at z~2 and z>3.5 and (2) contamination in our pVJL sample is mainly from dusty SFGs at z~2. 

We apply our sVJL criterion to the WFC3 ERS field to select 354 and 146 galaxies with J- and L-band 
S/N cuts greater than 10 and 20. The redshift distribution of our sVJL sample peaks at z~2.7. However, it 
also has a secondary peak around z~1.8. This secondary peak is induced by the color uncertainty, as the 
power of the secondary peak decreases with the increase of the S/N threshold. 

We compare our sVJLs with Lyman break galaxies at z~3 (U-band dropouts), assuming that the slight 
difference in the peak redshifts (< z >~ 2.7 for sVJLs and < z >~ 3.0 for U-band dropouts) would 
not result in any significant difference of properties of the two samples. In the ERS field, 39% of U-band 
dropouts are outside our sVJL selection window. Among the outsiders, 63% of them have redshift greater 
than 3.2, where our sVJL selection ability drops sharply. 

Unlike the Lyman break technique, our sVJL method can select galaxies whose (J-L) color redder than 
2.0, which implies high dust extinction in these galaxies. The measurement of E(B-V)s from the rest-frame 
UV continuum shows that U-band dropouts all have E(B-V)<0.4, while the distribution of E(B-V)s of sVJLs 
extended to E(B-V)~1.0. 

We evaluate the fraction of contamination from old galaxies in our sample of dusty SFGs (E(B-V)>0.3) 
by comparing their observed 24 fim fluxes to that predicted by an SSP model. We find that 18% of our galax- 
ies have 24 fim fluxes that match the prediction of pure stellar emission. The low fraction of contamination 
indicates that our sVJL method is effective at selecting dusty galaxies around z~3. 
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The dusty (E(B-V)>0.4) galaxies selected by sVJLs reside in the massive end (M star > 10 M )of 
the mass distribution of sVJLs. Although they only counts for ~20% of the number density in the mass 
bin 10 10 Mq < M st ar < lO n M , they contribute about half of the star formation in this mass range. In 
the low-mass end 1O 9 M < M star < 10 10 M Q , sVJLs and LBGs have no obvious difference on their color, 
E(B-V), and SFR. 

We also apply our criteria to the WFC3 ERS field to select PEGs at z~3. Through a similar comparison 
between the observed and predicted MIPS 24 ^m fluxes, however, we find that our pVJL samples are heavily 
contaminated by dusty SFGs. An additional condition is needed to clean the samples. Inspired by the fact 
that the majority of PEGs at z>2 is compact, we require galaxies to have a small radius (J-band Kron radius 
less than 1.0") to enter our pVJL sample. This extra criterion is proved to be able to effectively separate 
passive and dusty galaxies in our samples. 

The redshift distribution of our clean pVJL samples peaks at z~2.5 and extends to z~3, and even to 
z>4 when low S/N cuts are employed. We carry out case studies to examine the physical properties of 
our PEG candidates at z>3. Most of these galaxies have very low SFRs derived through SED-fitting but 
high SFRs derived from their rest-frame UV continuum. We try to use observations at longer wavelengths 
(MIPS, Herschel and AzTEC) to break the age-dust degeneracy and understand the nature of these galaxies. 
Unfortunately, the detection limits of these long-wavelength observations are too high to help achieve a firm 
conclusion. However, we find no significant detection even in the stacked image of AzTEC, suggesting 
that some our candidates are real PEGs at z>3. We speculate that galaxies with very low SFR, possibly a 
transition stage from star-forming to passive, begin to exist at z>4 and PEGs begin to exist at z>3. 

We estimate the ISMD of PEGs at z~2.5 by using our clean pVJL sample. We evaluate the incom- 
pleteness of observation and selection in a simplified way, which is proved to be accurate to the first order 
by comparing our results with other studies as well as by comparing results of samples with different S/N 
cuts. We also extend our measurement to z>3 and obtain a constraint on the ISMD at z>3. Combining this 
with low-redshift observations from previous studies, we find that the evolution of the ISMD can be divided 
into three stages: (1) formation stage (z>3), when PEGs begin to form and their ISMD grows by at least a 
factor of 10 in 1 Gyr; (2) rapid growth stage (l<z< 3), when the ISMD of PEGs grows by another factor of 
10 in 3.5 Gyr; and (3) slow growth stage (z<l), when the ISMD of PEGs grows by a factor of 3 in 7 Gyr. 
We discuss the possible mechanisms that drive the growth in each stage. 

We conclude that our new color selection criteria are effective at selecting SFGs independent of dust 
reddening as well as PEGs at z~3. This method is less model-dependent and easier to reproduce than 
methods based on SED-fitting so that it can be quickly applied to upcoming large optical and NIR surveys, 
such as CANDELS, where large samples obtained through wide survey areas would set stronger constraints 
and shed new light on our understanding of galaxy formation and evolution. 
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